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Abstract 

Spatial unilateral autoregressive model X^/ = aXf:_i^g + f3Xf^^£_i + ^Xi^_i^i_i+ek/ 
is investigated in the unit root case, that is when the parameters are on the boundary 
of the domain of stability that forms a tetrahedron with vertices (1, 1, —1), (1, —1, 1), 
(— 1, 1, 1) and (— 1,— 1,— 1). It is shown that the limiting distribution of the least 
squares estimator of the parameters is normal and the rate of convergence is n when 
the parameters are in the faces or on the edges of the tetrahedron, while on the vertices 
the rate is n^^'^. 
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1 Introduction 



The analysis of spatial autoregressive models is of interest in many different fields of science 
such as geograp hy, geology, biology and agriculture. A detailed discussion of these applica- 
tions is given by iBasu and Reinsell ( 1l993l ) where the authors considered a special case of the 
so called unilateral autoregressive model having the form 

Pl P2 

~ + ^k,ti «o,o = 0. (1.1) 

i=0 j=0 

a particular case of the above model is the so-called doubly geometric spatial autoregressive 
process 

Xki = OiXk^ij + l3Xk f_i — a/3Xfe_i £_i + Skit 
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introduced by iMartinI ( 1l979l ). This was the first spatial autoregressive model for which 
unstability has been studied. It is, in fact, the simplest spatial model, since the product 
structure ip{x,y) = xy—ax—f3y+af3 = {x—a){y—f3) of its characteristic polynomial ensures 
that it can be considered as some kind of combination of two autoregressive processes on the 
line, and several properties can be derive d by t h e ana logy of one-dimensional autoregressive 
process e s. Th i s model has been used by IJainI (Il98l[) in the study of image processing, by 
Martin ( 199o[) . CuUis and Gleeson ( 1991 ). Basu and Reinsel ( 1994 ) in agricultural trials and 
by lTj0stheinj ( 1l98ll ) in digital filtering. 

In the stable case when |a| < 1 and < 1, asymptotic normality of several estimators 



a 



m,m ym,n 



of ( a, 0) based on the obs erv ations \Xk/ : 1 < k < m and 1 < i < n} has 



been shown (e.g. lTj0stheiml (119781 119831 ) or lBasu and Reinsell (119921 119931 )). namely, 



"mn 



V 



Ar(0,S 



as m, n — > oo with m/n — > constant > with some covariance matrix Sa,/3. 

In the unstable case when a = P = 1, in contrast to the classical first order autore- 
gressive time series model, where the appropriately normed least squares estimator (LSE) 



Phillips 


( 


1987 


) or 



Newton estimators («„,,«,, /^ n.n) of (a, 13) has been shown to be asymptotically normal (see 
Bhattacharyya et al\ (1l996[ l and iBhattacharyya et al\ (119971 1). In the unstable case a = 1, 



< 1 the LSE turns out to be asymptotically normal again (IBhattacharyya et ali Il996l ). 

Baran et al\ (120041 ) discussed a special case of the model ( II. ip . namely, when pi= P2 = 1, 
tto,i = Q^i,o ='■ OL and ai^i = 0, which is the simplest spatial model, that can not be reduced 
som ehow to a utore g ressive niodel s on the line. This model is stable in case |a| < 1/2 (see 



e.g. 
In 



Whittle ( 



Baran et al 



954) 



Besagl ( I1972I ) or iBasu and Reinsell (Il993[ )). and unstable if 



\a\ 



1/2. 



(l2004f ) the asymptotic normality of the LSE of the unknown parameter a is 
proved both in stable an d unstable cases. T he case_2i^.22_5' L ^,0 =: «o,i =: and 



tti 1 = was studied by iPaulauskad ( 120071 ) and iBaran et all (120071). This rn o del is stable 
i n cas e \a\ + \/3\ < 1 and unstable if |a| + = 1 (IBasu and Reinsell . Il993l ). iPaulauskas 
(l2007l) deter r nined the exact asymptotic behaviour of the variances of the process, while 
Baran et al\ ( |2007l ) proved the asymptotic normality of the LSE of the parameters both in 
stable and unstable cases. 

In the present paper we study the asymptotic properties of a more complicated special 
case of the unilate ral model (11.111 wi t h P^ = P2 = 1, ai,o =: ^0,1 =: and ai^i =: 7. 
In a recent paper iGenton and Koull ( 120081 ) proved the asymptotic normality of minimum 
distance estimators in the case when model equation is valid on Z^. Here we deal with 
a model with boundary conditions, namely, we consider the spatial autoregressive process 
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Figure 1: The domain of stability of model fll.2p . 



{Xk,e : kj eZ, k,i>0} defined as 



Xk,e = aXk-i/ + (3Xk/-i + 7Xfc_i,^_i + ek,e, for kj>l, 
Xkn = Xo, = 0, for k,i>0. 



;i.2) 



This process has already been examined in iBararu (120111 ) where the asymptotic behaviour 
of the variances is clarified. The model is stable if (a,/3,7) G S, where S is the open 
tetrahedron with vertices 

V := {(1, 1, -1), (1, -1, 1), (-1, 1, 1), (-1, -1, -1)} 



(see Figured]). This result was proved by lBasu and Reinsell (119931 ) where the tetrahedron S 
was described by conditions \a\ < 1, \(3\ < 1 and I7I < 1, |1 + — — > 2\a + (3'y\ 
and 1-/3^ > |a + /37|. Short calculation shows that condition of stability means that 
\a\ < 1, \(3\ < 1 and I7I < 1, and inequalities 

a-/3-7<l, -a + /3-7<l, -«-/3 + 7<l, q; + /3 + 7<1 

hold. Obviously, in case a/37 > the above set of conditions reduces to |a| + \f3\ + < 1. 
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The model is unstable if {a, (3, 7) lies on the boundary of S, when one can distinguish 
three cases: 

Case A. The parameters are in the interior of the faces of the boundary of <S, i.e. (a, /3, 7) e 
T, where T :— U with 

J-+ {(«,/3,7) e (-1,1)' : «/97 > 0, |a| + \/3\ + I7I = 1} 

U {(a,/3,7) G (-1, 1)-^ : a/37 < 0, \a\ + - I7I = 1}, 

{(a,/3,7) e (-1, l)'^ : a(3-f < 0, |a| - + I7I = 1} 

U {K/3,7) e (-1, If : a/37 < 0, -|a| + m + |7l = 1}- 

Case B. The parameters are in the interior of the edges of the boundary of «S, i.e. 
(a, /3, 7) e where £ :— EiU £2^ £3 with 



Si 
S3 



{(l,/3,7) 
{(",1,7) 
{(«,/?, 1) 



/3 G (-1, 1), 7 = -/?} U {(-1, /3,7) : /3 G (-1, 1), 7 = /?}, 
a G (-1, 1), 7 = -a} U {(a, -1,7) : a G (-1, 1), 7 = a}, 
a G (-1, 1), l3 = -a} U {{a,l3, -1) : a G (-1, 1), /3 = a}. 



Observe that in each of the above three cases exactly two of the defining equations of set J-" 
are satisfied. In this way Case B can be considered as an extension of Case A to the situation 
when a/37 < ^''^^ o^is of the parameters equals ±1, while the other two parameters have 
absolute values less than one. 

Further, observe that in the first two cases 7 = —a/3, so we obtain special cases of the doubly 
geometric model. If {a,P,'j)ESi then for /c G N the difference Ai^aXk/ '■= Xk/ — aXk-i^e 
is a classical AR(1) process, i.e. Ai^^Xk/ = f3Ai aXk/-i + Sk/- Similarly, if (a,/3,7) G S2 
then A2,pXk/ = aA2,i3Xk-i/ + Ek/, where A2,i3Xk/ := Xk/ - f3Xk/-i, i e N. 

Case C. The parameters are in the vertices of the boundary of the domain of stability, i.e. 
(a,/3,7)GV. 

For a set H G {{k,i) El? \ k^l > 1}, the least squares estimator {an, Ph,^h) of 
(a, /3, 7) based on the observations {X^^j^ : {k, i) G H} can be obtained by minimizing the 
sum of squares 

{Xk,i — aXk-i/ — i3Xk/-i — ^Xk-i/-i) 
with respect to a, (3 and 7, and it has the form 



an 




/ 


Xk-i,e 




Xk-l,£ 




-1 


Xk-i,i 






E 


Xk,e-i 




Xk,i-i 






Xk,e-i 






^{k,e)eH 


Xk-i,e-i 




Xk-i,e-i 


J 


(k,l)eH 


Xk-i,e-i 



For n, m G N consider the rectangle 

Rn,m := G : 1 < i < n and 1 < j < m}. 
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For simplicity, we shall write i?„ := i?„,„ for n eN. 



Theorem 1.1 Let {ek/ : k,i E N} be independent random variables with Esk/ = 0, 
VaiEk/ = 1 and sup{Ee|^ : k,£ E N} < oo. Assume that model ( 11. 2p is satisfied. 

If (a,/3,7) G J-+ then 



[nm] 



as m, n — 7- oo with m/n ^ constant > 0, where 



n 



10-1 
1 -1 



■^(1) ^(2) 



with 



and 



K 



(1) .. 



(1 - ^''v + (1 - o.?Q%. ■■= (1 - - p)q':!, 



(2) 



.(2) 



A; + l) -P(^, 



k=0 £=0 

OO CXD 

EE(p(sff''"""' = *+i)-p(s£"'"""' = * 



k=0 £=0 



X iP(sl|fl'^-l-l) = £+l)-P((4f^-l-l) 



where S^^f"^ := + r^^'^'' and C.l''' and rif"' are independent binomial random variables 
with parameters {k,v) and {i,fi), respectively. 

If (a,/3,7) eSiU£2 then 



as m,n— 7- 00 with m/n ^ constant > 0, where 

1 |/3|sign(«) \{3\ 

\(3\ sign(a) 1 sign(Q;) 

1^1 sign(a) 1 



zf \a\ = 1, 



1 

|asign(/5)| 
sign(/3) 



\a\ sign(/3) sign(/3) 
1 |q;| 
lal 1 



^f \P\ = 1, 



and A denotes the adjoint of a matrix A. 
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// (a,/3,7) e V then 

{nmf/^{aR^ „^ - a, - /3,7iin.™ - 7) 
as m,n— i-oo with m / n ^ constant > , where 



V 



e„,« := 2 



1 -13 
1 -a 
-13 -a 2 



We remark that results given Theorem 11.11 do not cover the cases («,/5,7) G -7-"- U £"3. 
The main problem is that in these cases we could not handle the asymptotic behaviour of 
the covariance s tructure. A m ore detailed explanation and some results on the missing cases 
can be found in iBaranI (120111 ). Another problem is that we were not able to find closed forms 
of 



(i) 



1,2, and in this way we don't know how they depend on the parameters. 



For the sake of simplicity, we carry out the proof of Theorem 11.11 only for m = n. The 
general case can be handled with slight modifications. We can write 



7Rn -7 



with 









Xk-i/ 




Xk-i/ 






, 5n := Yl 


Xk/-i 




Xk/-i 


(fc/)Gi?„ 


Xk^i/^i 




Xk-i/-i 




Xk-ii~i 



Concerning the asymptotic behaviour of An and Bn we can prove the following proposi- 
tions. 

Proposition 1.2 // (a,/3,7)GJ> then 

n 



where 



1 - 1 


a 


V|/3| 


n{\a 


\ + m 



1/2 



1 



a,l3 



(l-|a|)(l-|/3|) 5(1 

1 sign{af3) sign(/9) 
sign(a/3) 1 sign(a;) 
sign(/3) sign(a) 1 



\a\ A 
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// (a,/3,7) e£iU£2 then 



n 



^ (2(1 -7^)) as n^oc. 



If (a,/9,7) e V i^/ien 



1 1 



n 











a 


1 








as n CO 


a(3 




a/3 





where W(s,t) zs a standard Wiener sheet. 
Proposition 1.3 // (a,/3,7)GJ-+ then 

n-^I^An ^ Ar(0, a^,^^a,/3) as n ^ oo. 
// (a,/3,7) G ^1 U^2 i/ien 

^ A^(|o, (2(1 -72))"^S„,^) as n ^ oo. 

// (a,/3,7) e V t/ien 



1 1 



n 



A y I w(s,t)>v(ds,dt) 





a/3 



as n — )■ oo. 



As the limits in Proposition 11.21 are singular, the statements of Theorem 11.11 can not be 
obtained dir e ctly f rom Propositions 11.31 and 11.21 Hence, one has to use the same idea as in 
Baran et al\ (|2007| ) and consider = _B„/det(i?„). 



Proposition 1.4 // (a,/3,7) €-7-"+ then 

det(5„) cr^_^ det [K.^^^ > as n -> oo. 
// (a,/3,7) G ^1 U^a i/^en 



n-Met(S„) (2(1 - 72)) ^ as 00. 



// (a,/3,7) G V i/ien 



1 1 



1 



n"^°det(5„) A ^ / / W^(s,t)dsdt as 
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We remark that using higher moment conditions on the innovations Sk/j after tedious 
but straightforward calculations, instead of stochastic convergence one can also prove L2 
convergence in the first two statements of Proposition 11.41 

Further, if we take appropriate linear transformations of An we have asymptotic nor- 
mahty in all of the unstable cases considered. Let C„ := l-LAn = {Cn \ Cn'^) , where 

C« := (1, 0, -1)A„= {Xk-i,i-Xk-i,e.i)sk,i, (1.3) 

:= (0, 1, -l)/l„= {Xk/-i-Xk-i,i-i)ek,i. (1.4) 

Proposition 1.5 // (a,/3,7)GJ-+ then 



n 



'^Cn A/'(0, /Ca,/?) as n ^ 00. 



If (a, /3, 7) e £1 then 

72-3/2^(1) A Ar(0, (1-7)-') and n-^C(2) AAr(0,(l-72)-^) as 00. 
If (a,/3,7)G£^2 then 

n-^C^ AAr(0,(l-72)-i) and n-'^'^C^^^'^ ^ M {^,{1 - ^Y^) as n ^ 00. 
If (a,/3,7) e V then 

n-^/^Cn^Af {0,12/2) as n 00, 
where I2 denotes the two-by-two unit matrix. 
Proposition 1.6 // (a, (3,'j) E J-'+ then 

n-^^/^-BnAn ^ A/'(o, al^p det [lC^^p)V7X^^pV}j as n^oo. 
If {a,P,-f) e£iU£2 then 

AAr(^0, (2(1 -72))-4S,,^) as n^oo. 



n 



The aim of the following discussion is to show that it suffices to prove Theorem 11.11 for 
a > 0, /3 > and 7 > if 0/37 > and for a > 0, /3 > and 7 < if a/37 < 0. In 
this way instead of J-^, V, £1 and £2 it suffices to use their subsets 

={(a,/3,7) : < a,/3 < 1, |7| < l,a+/3+7 = 1}, V+ = {(1, 1, -1)}, 
^1+ ={(l,/3,7) : < /3 = -7 < 1}, ^2+ = {(«, 1,7) : < a = -7 < 1}, 

respectively. 
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First we note that direct calculations imply 



= 5^ 5^ ^(A; - 2, £ - j; «, /3, 7)£„- (1.5) 

= E E ^ ! " r '1 ^'-'P'-'F (^-k,J-i■^ + J-k-i■-^] (1.6) 

i=i j=i ^ 



J 



k,i > 1, where (11. 6p holds only for a/3 ^ 0, 



rriAn 



G(m, n; a, /3, 7) := Yl ''lL. «"^"'/3""'^7^ m, n G N U {0}, 



r=0 



(m — r)!(n — r)!r! 



and F{—n, b; c; 2;) is the Gauss hypergeometric function defined by 



F{-n,b;c; z) := ^ 



r=0 



(c)r-r! 



and {a)r := a(a + 1 ) . . . ( a + r — 1) (for the definition in more general cases see e.g. 
Bateman and Erdelyil (119531 )). 



Observe that as for m, n G N we have F{—n,—m;—n — m; 1) = ('"^'^) ^ and 
F (—n, — m ; — n — m; 0) = 1, moving average representa tions of the doubly geor netric model 
of iMartinI (|l979l) and of the spatial models studied by iPaulauskad (120071 ) and iBaran et al. 
(I2OO4I . |2007| ). respectively, are special forms of (11.61) . 

Now, put Sk^t := {—lY^^ek,i for /c,£ G N. Then [sk/ : fc,^ G N} are independent 
random variables with E?fc/ = 0, YaiSk/ = 1 and supjEef^ : G N} < 00. Consider 
the process {Xk/ : k, i E Z, k, i > 0} defined as 



Xk,e = -aXk^i^i - f3Xk/-i + jXk-i/-i + Sk/, for k,£>l, 
Xk,o = Xo,i = 0, for k,£>0. 

Then by representation (II. 5p for fc, £ G N we have 



k I 

Xk/ = E E '^^^ -iJ- j; 

i=i j=i 

k I 

= E Y.^-lf^'—'G{k -ij- J- a, /3, 7)5., = (-1)'+%/. 
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Hence 









-1 



















-1 









Xk-i/-i 










1 












r 













Xk-i/ 


1 


-1 










-1 










Xk,e-i 




Xki-i 







-1 





Bn 





-1 







Xk-i/~i 




Xk-i/-i 










1 










1 



Consequently, in order to prove Propositions 11.21 - 11.61 for a < and /3 < it suffices to 
prove them for a > and /3 > 0. 

Next, put Ek/ := (-l)''^^,^ for A;,£ G N. Then {^fc,^ : A;,£ G N} are again independent 
random variables with E5fc £ = 0, Var^fc^^ = 1, and sup{Ee|^ : A;,£ G N} < oo. Consider 
the process {Xk/ : A;, £ G Z, /c, £ > 0} defined as 

Xk/ = -aXk-i/ + (3Xk/-i - '^Xk-i/-i + Sk/, for A;, £ > 1, 
.^fc,o = ^o/ = 0, for fc,£>0. 

Then by representation (11. 5p for fc, ^ G N we have 

k t 

Xk,i = G{k -i,£- j; -a, /3, -7)?ij 

i=i j=i 

k I 

Hence 









-1 










Xki-i 







1 







Xk-i/-i 









T 


-1 



Br. 



E 

(k,e)eR„ 



Xk-ii 
Xk,e-i 
Xk-ii~i 



Xk-i,e 
Xki-i 
Xk-ii^i 



-10 
1 
0-1 



Br, 



-10 
1 
0-1 



Thus, case a < and (3 > can also be obtained from case a > and /3 > 0. 

In a similar way we have Xk,e = {—^YXk/, where {Xk^e : k,i & k,i > 0} is defined 



as 



Xk/ = aXk-i/ - (3Xk,e^i - 7Xfc_i,^_i + €k,i, for k,i>l, 
Xk,o = Xo,e = l. for kj>0, 
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with Sk/ := {-lYsk/. Hence 





Xk-i,e 




1 










Xk,i-i 







-1 





(fc,^)ei?„ 


Xk-i/-i 










-1 





Xk-1/ 




Xk-i,e 


1 


1 










1 










Xk/~i 




Xk,e-i 







-1 










-1 







Xk-i/~i 




Xk-i/-^i 










-1 










-1 



Thus, case a > and /3 < can be obtained from case a > and /3 > 0, too. 

2 Covariance structure 



By representations (11 .Sp and (11. 6p we obtain that for /c2,^2 G N and a,/3,7 G M we 

have 

Cov(Xfc^,£^,Xfc2,^J=^ ^Y^G{kx -lAi - i;a,/3,7)G'(A;2 -i,^2 -i;a,/3,7) (2.1) 
i=i j=i 

kiAk2 iiAi2 /J , /) ■ A /; 1 « ■ A 

h-3 



=EE 



^1 - J 



(2.2) 



xF( z-/ci,j-£i;i+j-A;i-£i;-^ )F(i-A;2,J-^2;^+J-A;2-^2;-^ 



where x Ay := min{x, y}, x, y G M, an empty sum is defined to be equal to 0, and (12.2 
holds only for a(3 ^ 0. 



The following lemma ( iBaranl l201ll Corollary 2.2) helps us to find a more convenient 
form of the covariances. 

Lemma 2.1 // < a, /3 < 1 and a + /3 + 7 = 1, then 

G{m, n; a, /3, 7) = P (^^^^^^ = m) = P (si^^"") = n) . 



With the help of (12. ip and Lemma 12.11 one can find upper bounds for the covariances 
(IBararu . I2OIII Theorem 2.4). 



Lemma 2.2 // (a,/3,7) G then 



|Cov(Xfcj,£^,Xfc2,(?j| < Cq^/jV/Ci + 4 + /C2 + 

with some constant Ca,i3 > 0. 



12 



Bar an, Pap 



// (a, /3, 7) G £^1 or (a,/3,7)G£^2 then 



respectively. 

If (a,/3,7) e V i/ien 



|7 



1-72 



17 



|fel— fe2 



1-72 



For n G N let us introduce the piecewise constant random fields 
for < s, t G M. 

The following result is a natural, but non-trivial generalization of Proposition 2.5 of 
Baran et al\ fl2007h . 



Proposition 2.3 // (a,/3,7) G J>+ i/ien t/iere exists a constant Ka,/3 > such that 



Cov{Y}^\s,,h)X:'ois2,t2)) - Cov{Y^;\sr,t,)Xfi\s2,t,)) 



r{n) 



in). 



for all n G N, < Si,ti, S2,t2 e M., with (i, j) G {(0, 1), (1, 0)}. 



In the proof of Proposition 12.31 we m ake use of the follo wing lemmas. Lemma 12.41 is an 
obvious generalization of Theorem 2.4 of Baran et all (2007), wh il e Lern ma 12.51 can be easily 
obtained from a generalization of Theorem 2.6 of iBaran et al\ (120071 ) using Taylor series 
expansion. 

Lemma 2.4 Let G N, /et < /i, z/ < 1 be real numbers and let ^^^^ and rj^^^ 
be independent binomial random variables with parameters (fc, z/) and {i,fi), respectively. 
Further, let Sj^f := ^^^^ + and let 



bk,e := Var (S*^^^^^) , Xj^k/ ■= (j - rrik/)/ \/h/. 



Then for all k,i eN and j G {0, 1, . . . , + i}, we have 



exp {-xlf,^j2) 



< 



C. 



where C^,;^ > is a constant depending only on fi and v (and not depending on k,i,j). 
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Lemma 2.5 Using notations of Lemma 2^_, for j G {0, 1, . . . , + £ — 1} let 

A.., := {P{sl^f = J + 1) - P{stf = j)) + ^^e-P ( - 4.//2)- 



Then there exists a constant Cf^^p > depending only on ^ and v (and not depending 
on k, £,j) such that 



A 



j,k,e\ 



< 



(,3/2 ■ 
''kl 



Corollary 2.6 Let < fi, u < 1 be real numbers. There exists a constant C^^^ > such 
that for all A;,£gN and j G {0, 1, . . . , A; + £ — 1} we have 



< 



Proof of Proposition [2T3l Without loss of generality we may assume = (1,0). Let 

c^S(5i,ti,52,t2) := Coy{Yf;\s,,t,),Y^;\s2M) - Cov{Y^;\s,,t,),Y^;\s,,t,)) 

Consider first the case [nsi] > [ns2] and [nti] > [nt2]- Obviously, one may assume 
[^^2] > 1 and [72^2] > 1. From the definition of random fields f/q'* Yq^ with the 

help of Lemma 12.11 and (12. ip we obtain 



[ns2] — 1 [nt2] — 1 



A:=0 £=0 



tl]-lns2]+k,lnt,]-lnt,]+i = i'^^l] " ['^^s] + ^ + l) 

ns,]-[ns2] + k))p{sif-'^ = k). 



nsi]-[ns2]+k,[nti] — [nt2]+£ 

Hence, one can use the local versions of the CLT given in Lemmas 12.41 and 12.51 yielding 
approximation 



^S(^i'^i'^2,t2) ~ ^^(51,^1,52,^2) := - 5Z Yl f(^k,hak/) 



[ns2] — l [71*2] — 1 



27r 



1 — a 

271 



k=l E=l 
[ns2] [nt2] 




1 1 



where 



and 



f{u,v) :-- 



exp 



2^) 



exp 



/(&M,W,aM,w)d2;d?/, 



+ 9a A' 



2(u + qa,p) 



bk,i := a(l-a)A; + /3(l-/3)£, q^^fs := a{l-a){[nsi] - [nsa]) + /3(1-/3)(K] - [nts]) >0, 
ak,i := {l-a)k - (l-/3)£, 9^,^ := (l-a)([nsi] - [^52]) - (l-/3)(Ki] - [nt^]). 
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Using Lemmas 12.41 and 12.51 as for 2; > we have zexp{—z) < 1, direct calculations show 
that for the error 

tl, S2, t2) := ti, S2, ^2) - tl, S2, 

we have 

|AS(Sl,tl,S2,t2)| <Q^(Ai';;,'Hsi,ti,S2,t2)+Ai';;j'Hsi,'^l,S2,t2) + +Ai^^^^ 

where Ca^p is a positive constant and 

[ns2\-l[nt-2\-l [ns2]~l ^ [ni2]-l 



Ai"^^^(si,ti,S2,t2) := E E ir'^^^i 



fc=2 £=2 ' 2fefc,£ 

[nS2] — 1 [nti]-! 



1 / (Ofe/ + fi'Q,/?) 



Ai-^H^i,ti,.2,t2):= E E 06:7T^-p(- 



k=2 1=2 ^kA^k/ + qa,/^) ^ 4:{bk/ + qa,is) 



Obviously, as e.g 

[ns2]-l [71*2] — 1 



E E 4^^2(a/3(l-a)(l-/3)) '/' + 2D„,^ with D^,^ := {a(3{l-a){l- (3)byj) ' 
k=i 1=1 ^k,t 

it is not difficult to show that a[^"^^^(si, ti, S2, ^2) is bounded from above with an upper 
bound not depending on si,ti,S2,t2 and n. Further, 

[ns2] [nt2\ ^ 

A^:fis^,h,S2,t2)<^ I I ^e^p(-^)d^dy (2.3) 

1 1 ^'^ ^'^ 

— 7 m7 \7 m / / ^ ^^P ( I '^^ 



(a + /3)(l-a)(l-/3) i 7 ^ V 2m 

As for some real constants r and m > 

exp ( - ^^)d. = y^^f ^1 (2.4) 

holds, where $(x) := 2$(\/2a;) — 1, x G M, is the Gauss error function defined with the 
help of the cdf $(x) of the standard normal distribution, using (12. 3p and (12. 4p with m = 2 
and r = we have 

Ai"f (si,ti,S2,t2) < 8V2^H^,p < 00, where H^^p := ((a + /?)(! - a){l - /3)6lf')"'. 
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Using the same ideas we also obtain 

Ain,3)f . .x^ 4 r r 1 f + 

A\ r,'[si,ti,S2,t2) < -, TTTT- TT- — / / 7 — exp - — -]dvdu 

bl,l «l,[n*2] 

SO there exists a constant < iC^^^ < oo not depending on Si,ti,S2,t2 and n such that 

|AS(.i,ti,52,t2)|<<^. (2.5) 

Further, let 

^S(5i' «2, ^2) := ii, S2, ^2) - ^1, S2, ^2), 

where 

[ns2] [nt2] 

E^^l{si,ti,S2,t2) := -^^^ I I f{by,„ay^,)dzdy. 

Obviously, 

|AS(si,ii,S2,t2)| < ^[A'^:;f{s^,h,S2,t2)+A'^:fis^,h,S2,t2)), 



1 1 



1 — a 

where 

[ns2] [nt2] 



^S^(5i'^i'^2,t2) := j j |/(6[2,],[^],a[2,],[^]) -/(6[2,],[;,],aj,,;,)|d^dy, 



1 1 

[ns2\ [nt2] 

, (",2) 



(^i'^i'^2,t2) := y y |/(6[j,],[^],a3,,^) -/(6j,,„aj,,,)|d2;d2/. 
1 1 

As \z — [z\\ < 1, 2; G M, and for 2; > we have 2;exp(— 2;) < 1, and |1 — exp(— < \z\^ 
while for z>l, z > [z] > z/2 holds, long but straightforward calculations yield 

[ns2] [nt2] 

Oy,z 



1 1 



Now, using similar ideas we obtain 

[ns2] [nt2] ^ [ns2] [nt2]^ 

Al"^)(Sl,tl,S2,t2)< 



X 



exp f- %i±^) _ exp f- %1) exp (- i^MM±^) d.dy. 
26j,,,/ 2{by,,+qa,0)J 26,,,/ 2(6,,,+g«,^) ' 
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Hence, 

[ns2]+l [ni2] + l 



1 1 

[ras2] [^1*2] 




X exp I ' r- 1 + 



1 1 



and as [a^^^ — a|^j | < 4 + 4|ay,, A [,] |, short calculation shows 

[ns2] [nt2\ 2 \ 

Ai';;?^(si,'^l,S2,t2)< 16v^(D„,;3 + i/,,;3)+8 j j (^-1^ + ^ exp ( - ^) j dz d|/ 

[ns2] [".t2] 



+8 / / , ' , exp (- )d.dy < 32v^(D.., + g.,,) 

1 1 

[ns2]+l[nt2] + l 

('2) 

Thus, there exists a constant < K^'^ < oc such that 

|AS(^i,ti,.2,t2)| <<^. (2.6) 

(3) 

Finally, one has to show the existence of a constant < ^ < oo such that 

|i?S(si,ti,S2,t2)| <i^i% (2-7) 

which together with fl2.5p and (12 ■6p imphes the statement of the proposition. 
Consider first the case 6[ns2],i ^ ^i,[nt2]- this case 
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where 

6[ns2],i u/a-(a+/3)(l-^)/a 

E^a,i3\si,ti,S2,t2):= J J f{u,v)dvdu 

bi,i -u/P+(a+P){l-a)/l3 



61,1 61,1 

6i,[nt2l -w//3+(a+/9)(l-")[ns2]//9 

^i?/3^^(^i'^i'«2,^2) := J J f{u,v)dvdu 

6[n«2],i -«//3+(a+^)(l-a)//9 



6[ns2],[nt2l -«//3+(a+/9)(l-a)[ns2]//3 
bi,[nt2] u/a-{a+0){l-l3)[nt2]/a 

b[ns2],l"t2] b[„t2],lnt2] 



^l,[nt2] ^l,[nt2] 

with 

F(u, V) := //(a. .) d. = exp ( - ^) oxp ( - ^^±i^^ 



2(2M + ge«,;9)2/2 2{2u + qa,fi)J \{2u{2u + qa,fi){u + qa,fi)y/^ 

Combining similar terms we obtain 



b[nS2],l 



61,1 

&l,[7it2] &[nS2],["t2l 

61,1 h-ns2],l 
&[ns2],[nt2] 

F( M, 



M-(a+^)(l-/3)K] V^' 



6l,[nt2] 
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As for M > 



|FK.)|<-exp(-- 



exp 



(2.9) 



using Taylor series expansion we have 



F\ u 



u-{a+l3){l-l3) 



f'[nS2],l 



a 



)d.<|i-exp(-l( 



l/uV2 (a+/3)(l-/3)x2 



a au 



1/2 



dw (2.10) 



2(2M + g,,;3)3/2''''Pl 2(2M + g,,^) 

|5<,,;3|/{2fei,i+g„,^)V2 



fe[ns2l,l 



''1. 



dn < / — exp , 

- ' ' 2m ^ V 2a2 



■u \ (a + 



2aM3/2 y 



dw 



/ exp (- wV2)dM; < 



(a + /3)(l-/3) 1 

" + 2^^te 



l9Q,^(|/(2fe[„s2],i+9Q,/3)^''^ 



(2&l,l+g„,/3)VV \^(26f„,^]^i + g^_^)l/2 



^ («+/3)(l-/3) ^ l^yfei,! 



2 'V2a2 



where ii^i (x) is the exponential integral (lAbramowitz and Stegunl . Il972l ) 



-e""" log f 1 + < Ei{x) := / - — du < e"^' log f 1 + - V x > 0. 
2 V X/ J u \ X/ 

X 

Since the right hand side of (12.91) is an upper bound for \F{u, —v) \ as well, same calculations 
as in fl2:T0D yield 



fc[ns2],l 



Fi u 



-u + (q;+/3)(1-q;) 



2 V2/3 



-TT. 



(2.11) 



Now, using again fl2.9p . as < &[ns2],i) '^^ have 
^ ^ -M + (a + /3)(l-a)[ng2] ^ 



'[n32l.["'2l 



"['"21,1 

where 



/3 



d«< -°+^l'i-°' +.+£'"'fa.t,). (2.12) 



1/2 



'[ns2l,["t2l 



^11(^2, t2) : = 



— exp 
2u ^ 



{u-{a + P){l~a)[ns2]y 
2^2^^^ 



du. 
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Assume first {I — (3)[nt2] < {1 — a)[ns2] implying 6[ns2],[nt2] ^ (c^ + ~ Q^)['^'52]- In this 
case 



^["S2l>["'2l 



2^[ns2],l J ^2'Kh\ns2\,[nt2\P 



exp 



{u-{a + P){l-a)[ns2]f 



6[n32],l 



2&[ns2],[nt2]/5^ 



< 



{2Tx{a + l3){l-a)[ns2]Y'^(3 2(3 (a + (3 



2a{l — a)[ns2\ a \1 — ay — a)-^/^ 



1/2 



< 



(2.13) 



Further, assume {l—(3)[nt2] > {l—a)[ns2] > I— (3 implying b[ns2],lnt2] > {<y+f3){l—a)[ns2] > 
b[ns2],i- Thus, 



{a+l3)(l-a)[ns2] 



^^:1{S2M)< J 



1 



{u- {a + f3){l-a)[ns2]Y 
2&[ns2],i V 2/32(a + - a)[ns2] 



exp 



'[ns2l'["'2l 



+ 



exp 



2u ' \ 2(3 



1 f^i/2 {a+(3){l-a)[ns2] ^'^ 



u 



1/2 



(a+/3)(l-a)[ns2] 



< 



2/3/a+/3\ 
a \ 1— a/ 



1/2 



'\/^["32l>["'2l 



+ 



exp 



du (2.14) 
(w - >/(« + /?) (1- a) [ns2])' 



2/32 



dw 



< 



+ 



A/(a+/3)(l-a)[ns2] 

27r/32 N V2 



< 



+ 



A(3 



a(l-a)i/2 \^(a + /3)(l-a)[ns2]y «(l-a)i/2 



1/2- 



Finally, suppose (1 — a;)[ns2] < 1 — /? implying (a + /3)(1 — a)[?iS2] < &[ns2],i- ^^is case 



45(^2, t2)< 



1 



'\/''["S2lJ"*2l 



lI/2 
"[ns2],l 



exp 



1 ^^_{_a + (3){l~a)[ns2]\^ 



2/32 



that together with fl232|) - (EUl]) yields 



[ns2],l 



4/3 4 



a/2 - a(i_a)i/2' 



''[n32],[nt2l 



^"21,1 



-u + {a + (3){l-a)[ns2\\ 



dw < 



a/3(l-a)V2 ((a+/3)(l-a))i/2 



-TT. (2.15) 



Using similar arguments one can easily show 



'>[nS2],{nt2\ 



u-{a+P){l-P)[nt2] \ 



a 



du < 



+ 



a/3(l-/3)i/2 ((«+^)(i_^))i/2 



+ 7r. (2.16) 
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Now, representation (ESD together with fl230D . flCTD . f l2J[5D and fl216D directly imphes (E 
that completes the proof in the case [nsi] > [ns2], [nti] > [nt2] and &[ns2],i — ^i,[ni2]- 

Further, if &[„s2],i > ^i,[nt2l representation (I2.8p also holds for i?^"^(si, ti, S2, ^2) directly 
implying { \2.7\i . 

By symmetry, case [nsi] < [ns2], [nti] < [nt2] can be handled in the same way as case 
[nsi] > [ns2], [nti] > [^^-^2], while in case [nsi] < [ns2], [nti] > [^^^2] we have 



^^(^1, ti, S2, t2)= y: e (1 - ") (p(^S£f-\„.2R. =k+i)- p(5i:i;a„,,^, = ^) 



[nsi]-l [71*2] — ! 

V -/ 

[nt2]-l 

Thus, local versions of the CLT given in Lemmas 12.41 and 12.51 yield approximation 

[nsi] [71*2] 

1 1 

where now 

f{u,v):= " ~ ^^'"'^ cxpf ) c::p f (^"^w)' ^ (2.17) 

(M + a5fl,a,/3)l/2(M + /35(2,Q,/3)3/2 V 2(M + a5(i,a,/3) / V 2{u + (5g2,a,p)'' 

and 

fi'i.a./s := {l-a){[ns2] - ^Si]), 5(2,a,/3 := (1-/3) ([nti] - W)- 

Using similar ideas as in case [nsi\ > [ns2], [nti] > [^^^2] one can show that the error of 
the approximation is bounded with a bound not depending on si,ti, ^2,^2 and n. 

Substituting [nsi] for [77,52] in (12. Sp we obtain a representation of ti, S2, ^2) 

with the help of integrals of F{u,v) := / f{u,v)dv where f{u,v) is defined by (12.1 7p . 
Further, for m > we have 

\\^ 1 f {v + 9l,a,p)^ \ ( {v-g2,a,f}y 

\F[u,v)\<- -r-pr- -— jr-exp — — - ) exp ' 



{u + agi^a,i3y/'^{u + f3g2,a,i3y^^ ^ 2{u + agi^a,i3)^ ^ '^{u + f3g2,a,f}) 

V27l\gi,a,l3 + g2,aM ( (fi'l,o,/3 + g2,a,pY 



2(2m + + g2,a,/3)^/^ V 2(2m + + ^2,0,/?) 

that is the analogue of (12. 9p . Hence, after long but straightforward calculations similar to the 
proofs of (12.1 op and (I2.15P one can verify (12. 7p that completes the proof in case [nsi] < [ns2\, 
[nti\ > [nt2\. Finally, case [nsi\ > [ns2], [nti] < [^^2] follows by symmetry. □ 

Proposition 2.7 Let < Si,ti, S2,t2 e R and let (gi, ^2), ('^i, ^^2) G {(0, 1), (1, 0), (0, 0)}. 
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n 



If (a, /3, 7) G then 



cov(y^i(.i,ti),y,^4(.2,t2)) 



1/2 



7rV2(a + /3) 1/2(1 -a) (1-/3) ' 



if si = S2 and ti = ^2, 



otherwise, if (1 — a){si — S2) 7^ (1 — — ^2) tends to 0, as — )■ 00. Moreover, 
convergence to /ias an exponential rate. 



If (a,/?, 7) G £^1+ i/ien 



Jim -Cov(i;^:)^(,^, i^), y W^(,^, t2)) 

while for {a,f3,-y) G £^2+ we have 

lim icov(i;(;:)^(,^,i^),yW^(,^,t^)) 



■(si As2)/3l«^-^'^l(l-7')-\ ^/ ti=t2, 
0, otherwise. 



it,At2)a\'^^-^-\a-lT\ if Si = S2, 
0, otherwise. 



Moreover, convergences to m 6oi/i cases have exponential rates. 
If (a,/3,7) G V+ t/ien 



lim ^Cov(i;^4(si,ti),i;S^(s2,t2)) = (Sl A S2)(tl At2). 



n— >-cxD fl 



The proof of the above Proposition is strongly bas e d on the following Lemma that is an 
obvious generalization of Theorem 2.3 of iBaran et all (120071). The statement of the Lemma 
can be obtained from Hoeffding's inequality (IHoeffdingl . 119631 ). 



Lemma 2.8 Using notations of Lemma 2.4 let 



uk + ^e , J xlogf + (1 -x)logi4, xg[0,1], 

:= — — and hix) :^ 



k + 



00, 



otherwise. 



Then for x ^ 6 we have Ig{x) > Ig{6) = 0, and 

P(^l7^ >{k + £)x) <exp{-{k + e)Ie{x)) , for all x>e, 
P{siy^ <{k + e)x) <exp{-{k + i)Ie{x)) , for all x<e. 



P roof of Prop osition 12.71 Let (a,/3,7) G 7"++ and let < s,t G M. By Theorem 1.1 
of iBaranI (120111 ) we have 



lim ^Varfy(")(s t)) - ((1 " A ((1 - /3)t)^/^ 

ni/2 ^^H^o,o [s, t)) - ^^/^^^ ^ ^^^/^^^ -«)(!-/?)' 
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Now, as e.g. 

Cov(F/J(s,t),F£)(s,t))=Cov(Fo^J(.,t),FjJ(. + l/n,t)) 

+Cov {y};\s, t), Y^;\s, t)) - Var t), F^^H^, t)) + Var (F^^^ t)), 

by Proposition O the limit of n-'^/^Cov{Yi^J^^{si,ti),Yr^^}-^{s2,t2)) as n — oo equals the 
limit of ni/2Var(FjJ(s,t)) for all (gi, gs), (n, r^) G { (0, 1), (1, 0), (0, 0)}. 

Assume first Si > S2, ti > ^2 that implies [nsi]+gi > [ns2]+ri and [nti]+q2 > [nt2]+r2 
if n G N is large enough. In this case Lemma 12.11 and (12. ip imply 

[ns2]+ri — 1 [nt2]+r2 — 1 
A:=0 £=0 

where 

5'i,n := \ [nsi] - [ns2] + gi - g2,n ■= \ [nti] - [nti] + q2-r2\- 

We are going to apply Lemma 12.81 for the terms of the above sum. Let 

a(^i,n + A;) + (1 -/3)(^2,n + ^) a{si - S2) + {I - I3){h - t2) „ 

•= ; 7, =• 

gi,n + k + g2,n + ^ Si- S2 + ti-t2 

9i,n + k „ (l-a)(si-S2)-(l-/3)(ti-t2) 

9l,n + k + g2,n + ^ Si- S2+ti-t2 

as n — )■ 00. If (1 —a){si — S2) > (1 — — ^2) then a; > 0. Hence, for sufficiently large 
n G N we have a;„ > a;/2 > and in this way 

for all G {0, . . . , [ns2\ + ri — 1} and £ G {0, . . . , [nt2] + ^2 — 1}. Further, for sufficiently 
large n G N and for all A; G {0, . . . , [72^2] + ri — 1} and £ G {0, . . . , [^^2] + ^2 ~ 1} 

+ A; + 5'2,n + ^ = [nSl]-[ns2] + [ntl]-[nt2] + ql-rl + q2-r2 + k + ^ > {si- S2+ti-t2)n/2 

holds, so Lemma [2.81 yields 

^ {9i,n + k + g2,n + l){en + uj/2)) < cxp ( - - S2 + ti - ta)/^^ (^^n + a;/2) /2) . 

Since w > implies Io^{On + u jl) > 0, with the help of the above inequality we obviously 
obtain 

n-V2Cov(FW^(.„tO,>t4(s2,t2)) ^ (2.18) 

in exponential rate as n — )■ oo. If (1 — a;)(si — S2) < (1 — /3)(ti — ^2) then a; < 0. Hence, 
for sufficiently large n G N we have a;„ < u;/2 < and in this way 

= 9i,n + k)< P(5(-X,„^, < {gi,^ + A: + g2,n + + uj/2)) 
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for all k E {0, . . . , [ns2] + ri — 1} and i E {0, . . . , [nt2] + r2 — 1}. Using again Lemma [2781 
we obtain 

^{^iT.+kL.^+i < i9i,n + k + g2,n + i){en + uj/2)) < exp {- n{s, - S2 + h ~t2) leA^n + 00 / 2) / 2) , 
which directly implies f l2.18p . 

Case Si < S2, ti < t2 follows by symmetry. Let si < S2, ti > t2, so for sufficiently 
large n G N we have [nsi] + qi < [ns2] + ri and [nti] + ^2 > [^^2] + f2 and 

[nsi]+gi-l [nt2]+r2-l 

Now, let 

(1) ^ a(^l,n + /C) + (1 - (2) ^ afc+(l-/3)(^2,n + ^) ^ 1 . 

:= I ^ , - ^i^) ^ 1 - «, := - 9^^^ ^ -(1 - 

as n — )■ 00. Using the same ideas as before one can easily show that for sufficiently large 
n e N and for all k e {0, . . . , [nsi] + gi - 1} and i e {0, . . . , [rata] + ^"2 - 1} 

P(^^:^;+g = gi,n + fc) < exp ( - n{s2 - .i)/,a) (^^ + (1 - «)/2)/2) , 

P(^K,:S = ^) < exp ( - - t2)/,(.) - (1 - /3)/2)/2) , 

implying fl2.18p . 

Case si > S2, ti < t2 follows by symmetry, too. Finally, let e.g. si = S2, ti > ^2, so 
for sufficiently large n G N 

[nsi]+riAi3i — 1 [nt2]+r2-l 
fc=0 ^=0 

Hence, this case and the remaining three cases can be handled in the same way as the earlier 
ones. 

Now, let (a,/3,7) G £i+. Obviously, 
Cov(lt),(.i,ti),F^:4(.2,t2)) = {{[ns,]+q^) A ([n.2] + n))/3l["*^l-["*^]+^--l 

1 _ f^{[ntl]+q2)^{[nt2\+r2) 

that immediately implies the statement of the Proposition. Case (a,/?, 7) G £2+ can be 
handled in the same way. 

Finally, in case (a,/3,7) G V+ the statement directly follows from Lemma [2.21 □ 
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3 Proof of Proposition 11.2 



According to the results of the Introduction in the following sections we may assume a > 0, 
P > and 7 > if a(3'y > and a > 0, f3 > and 7 < if a/37 < 0. In this case 
"^0,13 equals the three-by-three matrix of ones denoted by 1, 



1 a(3 (3 
af3 1 a 
(3 a 1 



and under the conditions of Proposition 11.21 the coefficients G{k — i,i — j;a,/3,7) in 
representation fll.Sp of X^/ are non-negative. 

Obviously, 



1 1 





/ 


Xk-i/ 




Xk-i,e 






Xk/-i 




Xk,e-i 


(fc/)Gi?„ 


v 


Xk-i,e-i 




Xk-i/-i 



-1 T 







\ 



Cov{Yff{s, t), yI;\s, t)) Cov(yo?(., t), Y,^;\s, t)) 



Gov (fJJ t) , f/J {s,t)) VarF/J {s,t) Gov (F /J t) , ^, t)) 

Gov(yJ?(^,t),FjJ(.,t)) Coy{Y};\s,t),Yi;\s,t)) varyo(;)(5,t) 

By Lemma 12.21 if (a, /3, 7) G -7-"++ then 



ds dt. 



n 



-1/2 



Gov(y^^;)^(s,t),rJ;:4(s,t)) < c«,;3n-i/2(2H + 2[nt] + 2)'/' < c„,^ (2s + 2t + 2)^/2^ 

where Ca,^ is a positive constant, while in case (a,/3,7) G U £^2+ we have 



-1 



Cov(y;^),(.,t),y;^4(.,t)) 



< 



1-72 



1-72 



(O'l) ^2), ('"i, ''"2) G {(0, 1), (1, 0), (0, 0)}. As both upper bounds are integrable on the unit 
square [0, 1] x [0, 1], the dominated convergence theorem applies. Hence, if (a,/3,7) G 
by Proposition 12.71 we obtain 



1 1 



lim 



5/2 



((1 - a)sY'^ A ((1 - (5)tY^''ds dtl = al^pl, 



1/2, 







v/vr(a + /3)(l-a)(l-/3) 

while in case (a, /3, 7) G £^1+ U £2+ we have 

1 1 

lim — E5„ = / / (sl{c,=i} +tl{/3=i})dsdtE 

n->-oo n 1 — 7^ J J If J / 



1 







2(1-72)- 



(3.1) 



(3.2) 
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where \h denotes the indicator of a set H . 

Besides (13.11) and (I3.2p to prove the first two statements of Proposition 11.21 one has to 
show 



— Var^ ^k-l+qi,t-l+q2^k-l+rxl-l+r^ (3.3) 

~ CoV^Xfcj_i_(_q,^^^^_l_l_q2X^.^_l+r^^£j_l+r2 7 -^fc2-l+'?i/2-l+g2^fc2-l+ri/2-l+r2^ 

R n 



(fcl,^i),{A:2/2)Gi?„ 
1111 

1 








as n oo, where {gi, ^2}, {^^i, ^^2} e {(0, 1), (1, 0), (0, 0)} and 



^ , 5, if (a,/?, 7) e 7"++; 
^ 6, if (a,/3,7)G^i+Uf2+. 



Using Lemma 2.8 of iBaran et al\ ( 120071 ) we have 
1111 




covfe^(si,ti)ni^4(.i,ti),F,(;:)2(.2,t2)n^u^2,t2))^ 



0000 

1111 





1111 







which by Lemma 12. 2[ Proposition 12.71 and by the dominated convergence theorem imphes 
(EJl). 

Finally, let 

Sn,l '■= (-^fc/-l — -^fc-l/-l) , Sn,2, '■= (-^fe/-l — -^fe-l/-l)-^fc-l/-l, 

{k/)eR„ {k,e)£Rn 

{k/)£Rn {k,e)eRu 

Sn,5 '■= (-^fc/-l — -^fe-l/-l) (-^fc-1/— -^fc-l/-l) , (3.5) 

{k/)eR„ 

ik,e)&R„ 
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Observe, that T„ is exactly entry (3,3) of the matrix Bn- In case (a,/3,7) G V-i 

k e 

j=i j=i 

so by the continuous mapping theorem (CMT) (jsiUingsley . 1968 ) 

11 2 11 

^Jn = II (^^Yi;\s,t)^ dsdt^ 1 1 W\s,t)dsdt 



as n — > oo 



follows from Donsker's theorem (jWichural . 119691 ) 

iF(;;)(s,t) = A W(s,t) as n ^ oo. 

i=i j=i 

Further, by (13. 6p we have 

k I 

Xk/ — Xk/^i = Ei^e and Xk/ — X, 



1=1 



k-l/ — £k,j- 



Using the independence of the error terms Eij short calculation shows 



ES-,,! = E^„,2 = n^in - l)/2, Var(S„,i) = Var(5„,2) = 0{ 



n 



implying 



n '^Sn,i 1/2 and n ^Sn,2 1/2 as n oo. 

Applying again the independence of ei,j it is not difficult to verify 

E^„,3 = ES'„,4 = 0, Var(S'„,3) = Var(S„,4) = 0{n') 

and 

E5„,5 = 0, Var(S„,5) = O(n^). 
Hence, for all S > we have 



-'^'^ '^^0, and n^^-^^.. 



,3 



as n — )■ oo. 



Obviously, 



y^ — 5'„_2 + 2S'„,^2 + ^n, 

(fc,£)eii„ 

y^ Xl^g_l = Sn,l + 25*^^2 + Tn, 

{k/)eRn 



y^ -^fc,^-l-^; 

(fc/)ei?„ 



fc-i,^ 



y^ -^^fe-lZ-^/c-lZ-l — Sn,2 + ^Ji, 

y^ Xk,i-iXk 

{k,e)€Rn 
Sn,3 + 'S'„ 4 + Sn,5 + ^n, 



(3.6) 



(3.7) 



(3. 



(3.9) 



(3.10) 



(3.11) 



so by fl3.10p and (13. lip each entry of n has the same limit in distribution, that 

completes the proof. □ 
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4 Proof of Proposition 11.3 



To prove the first two statements of Proposition 11.31 first we show that (v4„)„>i is a square 
integrable three dimensional martingale with respect to filtration {J-'n)n>i, where 
denotes the cr-algebra generated by the random variables {ek,e '■ {k,i) G Rn}- In order 
to do this consider the following decomposition of An — An-i, where Aq := 0. Let 
An\ i = 1,2,3, denote the components of An. By representation (11 .Sp . 

/lf-41= Yl E G(fc-l-^,£-l-j;«,/3,7K,. 

Collecting first the terms containing only with G -R„ \ Rn-i, and then the rest, 

we obtain the decomposition 

An — An-1 = An^l + £ k/An,2,k,e, (4.1) 

(fe/)Gi?„\fl„_l 

where = (A^^^J, aJ,^ O)^ and A„,2,fc/ = (4,2,fe-i/, 4,2,fe/~i, 4,2,fc-i/-i)^ with 

n k—1 

•= 5Z ^'^''^ Yl G'(A;- 1 -i,£-j;a,/3,7)£ij = E^a'^-^-^ei.^efc,™, (4.2) 

ik,e)eR„\R„-i (j,j)GRfc-i,A-Rn-i '==2 «=i 

n £-1 

5Z E G'(fc-z,£-l-j;a,/3,7)£,,, = EE/3^-i-%„,,£„,,, (4.3) 

{k,e)eR„\R„^i {i,j)eRk^e-i\Rn-i <?=2 j=l 

4,2,fc,f := E G{k -i,e - j;a,/3,-f)eij. (4.4) 
(«j)6-Rfe,<?nR„_i 

The first two components of An^i are quadratic forms of the variables {Sij : G 
-R„\-R„-i}, hence An^i is independent of J-'n-i- Besides this the terms An^2,k,£ are linear 
combinations of the variables {sij : G Rn-i}, thus vectors An,2,k,e are measurable 
with respect to J-'n-i. Consequently, 

E(An — I J^n-l) = EA„^i + An^k/^i^k/ \ J^n-l) = 0. 

ik/)&R„\R„^-L 

Hence {An)n>i is a square integrable martingale with respect to the filtration (J-'„)„>i. 



By the Martingale Central Limit Theorem (jJacod and Shiryaevl . 119871 ). in order to prove 
the first two statements of Proposition II. 3[ it suffices to show that the conditional variances 
of the martingale differences converge in probability and to verify the conditional Lindeberg 
condition. To be precise, the statements are consequences of the following two propositions. 
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Proposition 4.1 // (a, /3, 7) G then 

1 " P 

m=l 

// (a, (3, 7) G £^1+ U £2+ then 

1 " P 1 

/ . E((y4m — Am-l){Afn — ^m-l) | m-l) ^ 777:; ^ 

^cs ' 2 1 — 7"= 

m=l ^ 

Proposition 4.2 For a// 5 > 0, 

1 " 

m=l 

as n ^ oo, where r is defined by f l3.4p . z.e. 



as n ^ oo. 



rra— 1 



r : = 



5, if (a,/3,7) G 

6, zf (a,/3,7) G^i+U^2+. 



Proof of Proposition 14.11 Let 11^ '■= E((A„ — Am-i)(^m — ^m-i)^ I J^m-i)- First we 
show that if (a, /9, 7) G J^^. 



1 " 



(4.5) 



m=l 



while in case (a, /3, 7) G £^1+ U £2+ we have 

1 " 
hm — 7 EU„ 

n->-oo n 

Obviously, 



m=l 



2(1-72)- 



(4.6) 



Am — Am-1 — ^ ^ 

m — 1 



Xk-i,e 
Xk-ii-i 



and by representation ( II. 5p and independence of the Sij, the terms in the summation 
have zero mean and they are mutually uncorrelated. Since for all {(11,(12}, {1^1, ''^2} G 
{(0, 1), (1,0), (0,0)} products Xk-i+q^z-i+q^Xk-i+rui-i+ri and Ek/ are independent we 
obtain 



Et^m — E(v4m — Am-l){Am — Am-l)^ 



(4.7) 





/ 


















(fc/)GRm\Rm-l 


v 


-^A;-l/-l 




Xk-i,i-i 



Eefc,^ — — EBm-1, 
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where Bq equals the three-by-three matrix of zeros. Consequently, (14 .Sp and (14. 6p follow 
from fl3.ip and f l3.2p . respectively. 

By decomposition fl4.ip and by the measurability of Am,2,k,e with respect to J^m-i one 
can derive 

l^k/ I m-l)^m,2,fc/ + Am,2,k,i^{Ajn ie k/ \ T m-l) 

(k,e)(iRm\Ilm-l {k,e)eR„,\R^^i 



{fci/i)GR,„\_R„_i {k2/2)€Rm\Rm-l 



By the independence of Ajn,i and {efc,^ : {k,£) G -Rm \ Rm-i} from J^m-i, and by 
E(ylm„i£^fc,^) = (0,0,0)^, one obtains 



{k,e)eR,n\Rm-i 



T 

■m.2.k.t 



(4. 



This means that to complete the proof of the proposition we have to show that for all 
{gi,g2},{ri,r2}G{(0,l),(l,0),(0,0)} 



lim — Varfy^ Ajn,2,k-l+qi,£-l+q2^m,2,k-l+ri,e-l+r2 
n— i-oo n V 

m=l ik,e)eRm\Rm-i 



r,Ar 



0, (4.9) 



where r is defined by (13. 4p . Obviously, 



Var( XI XI ^ 

m,2,k-l+qi,e-l+q2Arn,2,k-l+ri,e-l+r2 

m=l (fc,£)eRm\Rm-l 



X X X X C0V^Ami,2,fci-l+gi,£i-l+g2^mi,2,fci-l+ri 



^1-1+^2) 



mi = l (fcl,^l)gi?mj\/?„j_l "12=1 {k2/2)&Rm2\Rn 



Ar 



m2,2,fc2 — l+<?l/2~l+(j2^ni2,2,fc2 — l+''"i/2 — 1+'"2 i 5 



and using Lemma 2.8 of iBaran et all (120071 ) we have 



Cov( Ami,2,fci-l+gi,£i-l+g2^mi,2,A;i-l+ri,^i-l+r2) ^m2,2,A;2-l+iji,^2-l+g2^m2,2,/c2-l+ri,£2-l+r-2 

<M4C0V ^Ami,2,fci-l+gi,£i-l+g2 5 ^"12,2, fc2-l+'2i ,^2-1+92 
X CoV^Ami,2,fci-l+ri,£i-l+r2 5 ^m.2 ,2,fc2-l+ri ,£2-l+'"2 
+M4CoV^ylmi,2,fci-l+(}i/i-l+g2! ^m2,2,A:2-l+ri,£2-l+r-2 
X Covl Ami,2,fci-l+ri,£i-l+r-2; ^^12,2,^:2-1+91/2-1+92 
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Moreover, by fl4.4p and representation fll.Sp 

Cov( A^^,2,fci,£i,^m2,2,fc2/2j = ^ G{ki-i,ii- j;a,l3,'j)G{k2-i,i2- j;(y,l3,'y) 

1 Af2^-'^™1^™.2-1 

< Gov I Xyfc^ £^ , Xfc2,^2 



Furthermore, 

n n 

X] C0v(^Xfci-l + gi,^l_l + g2,X, 

mi=l (fci,^i)ei?,„j\R„j_i m2 = l (fc2/2)G-R,„2\Km2-i 



^2 — l+<7l/2 — 1+92 



X CoV^Xfei-l+r-i,£i-l+r2 5 



fc2-l+ri,£2-l+-r2 



■ri,£i — l+r2? ^fc2 — l+fijfe — 1+''"2 



(A:i,^l),(fc2/2)Gfln 

Hence, 



n 

Var^^^ ^m,2,fc-l+m,^-l+g2^-m,2,fe-l+ri,^-l+r2 j < ^4 

( Gov ^Xfc^ _ i+g^ _ 1+52 , Xfc2 - l+gi ,£2 - 1+92 ) Gov ^Xfc^ _ i+ri - l+r2 > -^fc2 - 
+ C0V^Xfe^_i_,_q^_^^_i+g2! -'^fc2 — l+ri,£2 — 1+^2 



l+ri,£2 — 1+»'2 



(fcl,£l),(fc2/2)Gi?„ 



+ri,£i--l+r2) -^fc2-l+<?i/2-l+92 ) I' 



so ()4.9p can be proved in a similar way as (13.30 . 
Proof of Proposition 14.21 Since 

to prove Proposition 14.21 it suffices to show 



□ 



1 " p 

— E{\\Am - A^rn-lW^ \ J^m-l) aS U ^ OO, 



(4.10) 



m=l 



where r is defined by fl3.4p . By the decomposition fl4.ip of — A^-x and by the 
inequahty [x + yY < '^{x^ + y"^) for x, ?/ G M, 



Parameter estimation in a unit root AR model 



31 



By the independence of A^,! and J-m-i, we have E(||74m^i||^ | J-'m-i) = ^\\Am,i\ 
Applying the measurability of Am,2,k,e with respect to J-'m-i, we obtain 



Hence, in order to prove (14.101) . it suffices to show 



4 






m—1 



||^m,2,A;/| 

(k,e)eRrr^\R m — 1 



m=l 



1 

lim — > E 

n—^oo fi'' — ^ 

m=l \{k,t)eRm\Rm-l 

Using (14. 2 p and (14. 3 p it is easy to see that 

m fc— 1 



1 " 

lim — VE||/lm,if = 0, 

n— >-oo ' 

E 



(4.11) 
(4.12) 



m l-l 



||Am,ir < 2 I J^J^a'^-^-Wfc,™ ) +2 I ^^/3^-i-%m,,^ 

.£=2 j=l 



,k=2 i=l 



If < a,/? < 1 then by Lemma 12 of ISaran et all ( 120041 ) we have EUAm.iH^ = 0{m'^), 
while for a = 1 or /3 = 1 a short calculation shows that E||74m,i||^ = O(m^). Hence, 
( 14. lip is satisfied for both possible values of r. 

Furthermore, 



||^m,2,fc,f| 
(k/)&Rm\R m—1 



E^(74^_2,fci-l,^i + ^m,2,fci,^i-l + ^m,2,fei-l/i-l) 



' {kl/l)(k2/2)&Rm\Rn 



X 



(^m,2,fc2-l/2 + ^' 



m,2,fc2/2- 



-1 + ^m,2,fc2-l/2-l) ) ■ 



From Lemma 2.8 of iBaran a/.l ( 120071 ) follows 

E(^m,2,fci,^i^'^ 



m,2,fc2,fe) — ^M^EA^ 2,fci,^iE^m,2,A:2,^2' 



while using ( 14. 4p and representation ( II. 5p one can easily see EA^g,^/ ^ VarX/,.^^. As by 
Lemma 12.21 there exists a positive constant Ca b such that 



Var Xk,e < 
short calculation shows 



Ca,i3Vk + i, if (a,/3,7) G 

Q^(A; + £), if (a,/3,7) e£i+U£2+, 



5] \\Am,2,k,ef] =0^-2), 

(k,e)£Rm\R m—1 
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which imphes fl4.12p . □ 

Now, consider the case (a,/3,7) G V+. Let 

and Cn^ and Cn'' be the random sequences defined by (11. 3p and (11.41) . respectively. 
Using equation ( 11. 2p which in this case takes form AiA2Xfe_£ = ek,e with AiXk/ := Xk/ — 
A2Xk^i := Xk^i — from (13. 8p and CMT we obtain 

i,z„^ J: (ir<»)(^,^))A.Aiiyw(^,^)) 

11 11 
= 11 (^lY^;\s,t)^(^^Y^;\ds,dt)^ W{s,t)W{ds,dt) as n^oo. 



Further, using the independence of the error terms eij and (13. 9p short calculation shows 

EC(^) = EC^) = 0, Var(C(^)) = Var(Cf ) = 0{n% 

Hence, for all 6 > we have 

^-3/2-5^(1) J:^^ Q n-='/2-5^(2) ^ Q as n ^ oo. (4.13) 

Obviously, 

A„-z„(i, 1, iV = {ci'\ c^^\ oy, 

that together with (I4.13P completes the proof. □ 



5 Proof of Proposition 11.4 



According to the results of the Introduction it suffices to consider the case a > 0, (3 > 
and 7 > if a/S^y > and a > 0, /3 > and 7 < if a/S^y < 0. 

Consider the following expression of det(i?n) 

det(i?„) = ^ ^ ^ Wk^^l^^k2/2,k3/3^ 

(fcl/l)GR„ (fc2/2)eRn (fc3/3)e-R„ 

where 



+ -^fcl-lA^te/2~l^fc3-l/3-l~^fclA-l^'^'2-l/2-^A:2-l,fe-l-^A:3-l/3-^fc3-l/3 



1 



— X^^_^^^Xfc2^£2_lXfc2_l_^2_lXfc3^^3_lXfc3_l,^3_l— X^^_;^^^^_;LXfc2_^2_lXfc2_l_^2Xfc3^£3_lXfc, 



fe3/3-l- 
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Short calculation shows that 



W^fci,^l,fc2,^2,fe3,^3 = (-^fcl,^l-l— -'^fcl-l/l-l) (-^A:2-l/2~-^fc2-l/2-l) -^^3-1,^3-1 
+ 2(Xfc^^£^_l— Xjfcj_l^£^_l) (Xfcj_l^£^ —Xkj-l/-i-l) (Xfc2_^2_l — Xfc2-l,^2-l) 

(5.1) 

— {Xki/i-l—^ki-l/i-l) {Xki~l/i—Xki-l,£i-l) (-^fc2/2-l~^A:2-l/2-l) 

X (-^fc2-l/2 -^k2~l,e2-l)^k3-ll3-l 

— (-^fci,^i-l— (-^A:2 - 1/2 ~-^fe2- 1/2-1) (-^fc3-l/3 — -^fc3-l,£3-l)-^fc2-l/2-l-^fc3-l/3-l 

— (-^fci-l/i--^fci-l,<?i-l) {Xk2,e2-1^ ^k2-l,i2-l) (-^fc3/3-l~-^fc3-l/3-l)-^fc2-l/2-l-^fc3-l/3-l- 



First let (a,/3,7) G Using notations (13.51) introduced in Section [3l by representa- 

tion (15. ip we have 



n 



-13/2 det(i?„) ={n-'S^,,) {n-'S„„,) (^-^/^ T„) + 2{n-'Sr.,,) (n-^/^5„,3) (5.2) 



Obviously, 



1 1 

j j Cov(F/J(.,t),FjJ(.,t)) - Var(FjJ(.,t))d.dt, 







and w ith the help of (12. ip . Lemmas 12. II and 12.41 Corollary 12.61 and Lemma 2.8 of lBaran et al. 
(120071 ) one can show 



1111 



Var(5„,3)<ny jjj \Go^i{Y^;^ {s,M).Yli;i {s2M))-Go.^{Y^'S {s,M).Y^;^ {s^M))\ (5.3) 



0000 

X 



dsi dti ds2 dt2 



1111 



+n 




0000 
+ 

X 



where Ca,p is a 
convergence theorem imply 



Cov{Yl;\suh),Y^;\s2,h))-Cov{Y^;\suh),Y^:^is2,h)) 

Coy{Y};\s^,t^),Y^{s2 + l/n,t2))-Cov{Y^{s,,t^),Y^{s2 + l/n,t,)^ 

Cov(fJJ(si, ti), Y^;\s2, t2)) |dsi dh ds2 dt2 + n\M^ - 3)+C„,;3, 

positive constant. In this way Propositions 12.71 and 12.31 and the dominated 
em imply 

lim n-^/^ESn,3 = and lim n-^/^VaT(Sn,3) = 0, 
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and the same result can be proved for Sn,i- Hence 

and 



n-^/'S'„.3 ^ and n-^^'Sn 4 



as n — !■ 00. 



(5.4) 



Further, 



1 1 



ESn.i = n- 



llE{Y}:^{s,t)-Yi;\s,t)Ydsdt, 




and using representation (11.51) and Lemma 12.11 with notations of Lemma 12.41 we obtain 



E{Y};\s,t)-Y^;\s,t)) 



in), 



1-/32 

[ns]-l [nt]-l 



+ (1 - E E = A: + 1) - P(5(y-^) = k)) . 

fc=o e=o 

Obviously, E {y}^ {s,t) — Y^^^ (s, t)Y is a monotone increasing sequence and by Proposition 
12.31 it has an upper bound independent of s,t and n. Hence, 



hm E{Y};\s,t) - Y^;\s,tf = + (1 - a)^,i^) > 0. 

Similarly to (15. 3p one can show 



Var(S„,i)<n^(M4-3)+a 



1111 



+ 2n 




a,l3 



Cov{Yl;\s,,h)X;\s, + l/n,t2))-CoY{Y,';\s,,t,)X:o\s2 + l/n,h)) 



(5.5) 



(5.6) 



in), 







+ 



Cov(r5)(Si,t0,>^0y(^2,t2))-CovMy(.,,t0,n^y(32,t2)) 



dsi dti ds2 dt2 



where Ca^p is a positive constant. Again, Propositions 12.71 and 12. 3[ the dominated conver- 
gence theorem and (15. 5p imply 



lim n ^ES'n 1 



1-/3 



+ (1 - afot^ and lim n ^Var(S'„,i) = 0, 



and a similar result can be proved for Sn,2- Hence, 



n "^Sn 1 



L2, 



^{l-aYQt\ = ^^a!p and n ^5'„,2 



1-/32 



L2, 



+ {^-PfQZ = ^Z (5-7) 



l-a2 



as n — )■ 00. 
Finally, 



1 1 



1 1 E{Y}:^{s,t)-Y^;\s,t)){Y^:i\s,t)-Yi:;^{s,t))dsdt, 
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while for Var(S'„,5) one can find a result similar to (15. 6p . Using again representation (11.5 
and Lemma [2.11 we obtain 

E(r/J(.,t)-yo^J(.,t))(yoy(s,t)-yo(J(s,t)) = (i-a)(i-^^^^ 

where 

[ns]-l [nt]-l 



fc=o e=o 



independent of s,t and n, but one has to show that V^"^(s,t) has a limit as n — )■ oo. In 
order to prove this we show that for fixed s and t values V^"i(s,t) is a Cauchy sequence. 



By Proposition^ E (f/J (s, t) - Y^l' (s, t)) (Yq,! (s, - ^'o.o (^^ ^)) is bounded with a bound 

Let ?T,,m G N, n > m, < s,t < 1, and without loss of generality we may assume 
[ms] > 1 and [mt] > 1. The local version of the CLT given in Lemma 12.51 yields 
approximation 



ms]-l [nt]-l [ns]~l [nt]-l 



27T ^ ^ ' " 27r 

k=l l=[mt] k=[ms] 1=1 



where now 



while Ofc / and bk,i are defined in the same way as in the proof of Proposition 12.31 Using 
Lemma 12.51 one can easily show that for the error of the approximation we have 



([ms]-l [nt]-l [ns]~l [nt]-l 

E E 7F7^+ E Et^ (5-8) 
k=l e=[mt] '^k,e k=[m.s] i=\ "k,e 



8Cr.H ( \ 1 1 1 



< —77^ ^ ^77^ + ^7:^ + ; + ; ^0 



H-1 ^ \ns\-\ ^ 

£=lmt] k=[ms] l,[mt] [nis],! n i i ji 

as m, n — 7- oo, where C^^^ is a positive constant. Further, as 

F(..„):=//(«..)d.= -^exp(-H!)+ so l^".^)! < ^ 
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using the notations of the proof of Proposition 12.31 we obtain 

[ms] [nt] [ns] [nt] 

1 [mt] [ms] 1 

^[ms].[nt] <^[ms].[mt] f'lna] .[nt] <^[ns],l 



< 



-1/2 



J J f{u,v)dvdu+ J J f{u,v)dvdv^ 



bl,[mt] O'ljnt] i'[ms],l %ns],[nt] 



'[ms],[nt] f>{n3],{'nt] 



^l,[mt\ '-'[ms\,l 

as m,n ^ oo, which together with (I5.8P proves that V^"^(s,t) is a Cauchy. 
In this way 

hm E{Y}2\s,t) - Fo5^(.,t)) (Fo?(.,t) - = .g^, 

so by Propositions 12.71 and 12.31 and the dominated convergence theorem we have 
hm n^'^ESn,5 = (1 — a;)(l — « and hm n~'^Var(5'„,5) = 0. 

Hence, 

n~'^Sn,5 {I ~ - f3)g''^^fs = as n oo, (5.9) 

that together with (15.41) . (15. 7p and Proposition 11.21 imphes the first statement of Proposition 
11.41 Observe, the positivity of the hmit of n~^^/^ det(i?„) follows from the non negativity 
of Qa^isQ^s^a "~ (^i^^) ^^^^ ^ trivial consequence of the Cauchy-Schwarz inequality. 

Now, let (a,/3,7) G so 



k I 



In this way 

j=l i=l 

Using the independence of the error terms short straightforward calculations show 
E5„,2 = + (1 + 7)2et„, E^„,4 = -(1 + 7)ET„, 
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and 



Var(S'„,i) = 0(n2), Var(^„,3)= ^(n^), Var(S'„,5) = O(n^), 
Var(^„,2) = 0(^5), Var(^„,4) = O(n^). 



Hence 



and for all (5 > 



n-'I'-'S^,, ^ 0, n-2-^5„,5 (5.11) 



as n — )■ oo. As by representation (15.11) we have 



n 



det(5„) ={n~^Sn,i) (n-=^5„,2) T„) + 2(^-5/25^,5) (n-5/25„,3) (ri~'5„,4) 

Proposition 11.21 and limits (I5.10p and (15. lip imply the second statement of Proposition 11.41 

Case (a, /3, 7) G £2+ can be handled in the same way. 

Finally, consider the case (a,/3,7) G V+. As by representation (15.11) we have 
n-iOdet(i?„) ={n-^S^,,) [n-'^S^^^] (n-^Z,) + 2{n-'S^,,) (^-^/^S^.s) (n-^/25„,4) 

the last statement of Proposition II. 41 is a direct consequence of Slutsky's lemma, (13. 7p . (I3.10p 
and (Km . □ 



6 Proof of Proposition 11.5 



To prove Proposition 1 1 . 51 we are going to apply the same ideas as in the proof of Proposition 
11.31 Consider first the cases (a,/3,7) G J-'++ and (a,/3,7) G £i+ U £2+- As (A„)„>i 
is a three dimensional square integrable martingale with respect to the filtration {J-'n)n>i, 
random sequence 

Cn — Cn-1 = Cn,l + / , £ k,eCn,2,k,e (6-1) 



(fe/)Gfln\_R,„_l 



is a two dimensional martingale difference with respect to the same filtration, where 



A, 



(2) 
n,l 



a 



n,2,kl 



(2) 

n,2,k,i. 



A.n,2,k-l,e ~ A.n,2,k-l,e-l 
A.n,2,k,£-1 — An,2,k-l/-l 



(6.2) 
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with A^^\, A^j^\ and A„ 2,/c/ defined by (14. 2p . f l4.3p and f l4.4p . respectively. Here Cn,i is in- 
dependent of J^n-i, while Cn,2,ki is measurable with respect to it. However, representation 
(16. ip is also vahd in the case (a, /3, 7) G V+, when 



n— 1 n— 1 



{fc,^)G-R„\iJ„-i 



=1 i=l 



n— 1 n— 1 

{k,£)eR„\R„-i k=l j=l 



Hence, C„ — C„_i is a martingale difference in this case, too. This means that according 
to the Martingale Central Limit Theorem the statement of Proposition 11.51 follows from the 
propositions below. 

Proposition 6.1 // (a, /3, 7) G J>+ then 

1 " P 

~ ^ ] E((Cm — Cm-l){Cm ~ Cm-l)"'' | m-l) ^ ^o,/3 

If («,/3,7)e£i+ 



as n — )■ 00. 



m=l 

as n — 7- 00. 



m— 1 



' m=l 



1-72 



// (a, /3, 7) G £^2+ ^/ien 
1 " 



m— 1 



m=l 

as n — 7- cxo. 



11" 1 

1 _ ^2' 5Z ^(('^'^^ ^'^'^-i) 

' m=l 



7 



// (a,/3,7) G V+ t/ien 

1 " P 1 

— E((Cm — C'm-l)(C'm — Cm-l)^ \ m-l) ^ ^2^2 aS Tl ^ OO. 



m=l 



Proposition 6.2 // (a,/3,7) G -7-"++ i/ien /or a// S > 



~^ E fllCm - C'm__i|pl{||c^_c'™-i||>5n} 

m=l 

// (a, /3, 7) G (£^1+ U £2+ then for all 6 > 

^ E MCW _ <^iLiPlr|cW"C«_j>5n3/2} 

m=l ^ 

~T ^ E MC^-* — C^^j^l^l 

m=l ^ 



as n 00. 



'{\c'd^-Clll,\>5n} 



^ m— 1 
m— 1 
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as n — 7- oo, where 



(1,2), zf {a,(3,^)e£i+; 
(2,1), zf (a,/3,7) €^2+. 



// (a, l3, 7) G V+ i/ien /or a// 5 > 
1 " 



m=l 



m— 1 



as n —7- 00. 



Proof of Proposition 16. li The proof is very similar to the proof of Proposition 14.11 Let 
Vm := E{{C„, - Cm-i){Cm - Cm-iV \ J^m-i)- First we show that if (a, /3, 7) G 7"++ 



1 " 

lim — EVm = ICo 



(6.3) 



m=l 



if (a,/3,7) e £^1+ 
1 " 

lim — V(l, 0)EKn(l, 0) 

n— s>oo T^'^ ' 
m=l 

if (a,/3,7) G £2+ 



1-7' 



n 

hm -^(0, 1)EK.(0, iy = - -, (6.4) 

m=l 



n n 

hm - ^(1, 0) EKn (1, 0)T = hm - ^(0, 1) EV^ (0, 1)^ = , (6.5) 

m=l m,=l 

while in case (a,/3,7) G V+ we have 

1 " 1 
lim — V EK„ = -X2, 



(6.6) 



m,=l 



As Cn = 'H.An^ we obviously have = T-LUmT-L^ , where Um is the conditional 
expectation defined in the proof of Proposition 14.11 Hence, using notations (13. 5 p introduced 
in Section |3] and (14. 7p we obtain 



^ EKn = H EB^.n^ = E 



m=l 



Sn,2 Sn,5 



In this way (16. 3 p directly follows from (15. 7p and (15. 9p . (16. 4p is a consequence of (I5.10p and 
(15. lip . (16. 5p can be proved in the same way as (16. 4p . while (16. 6 p follows from (I3.10p and 
dSH]). 

Further, (14. 8 p implies 



m — 1 



T 



40 Baran, Pap 

This means that to complete the proof one has to show that if [a, /3, 7) G J^++ 

;^Var(5^ J2 ^Sw^U) ^ 0' forall z,j = l,2, (6.7) 

"1=1 {k,l)(iRm\R^-l 

if (a,/3,7) G Si+ 
if (a,/3,7) G S2+ 

ivar(^ 5: (CJ^O. >-(E E (6.9) 

m=l (k,e)€R^\Rm-i ra=\ (fc/)Gi?m\-R™-i 

while in case (a,/3,7) G V+ we have 
1 

;^Var ( J] ^S2,.,.<2,.,) = 0, for all ^, j = 1, 2, (6.10) 

as — 7- 00. 

By representation (11.51) of Xfc^£ and by definition (14. 4p of Am,2.k,i we have 

fc-i 

Am,2,k-l,m = ^fc-l,m ~ ^ ] Q; £^j,m) ^m,2,fc-l,m-l = ^fc-l,TO-l ^ = 1; 2, 

e-1 

Am,2,m,e-1 = Xm,e-1 — Z?^ ^ ''^rnj, ^m,2,m-l/-l = -^m-l,£-l; = 1; 2, ... , 

Am,2,m-l,k = ^m-l,fc; ^m,2,fc,m-l = Xk,m-li k = 1, 2, . . . , m — 1, 

SO according to (16. 2p it is not difficult to see that 



.,^,...,m, 



, m 



(Cm,2,fe/) ~ "^".s + ci^j - 2c, 

m=l {k,e)eRm\Rm-l 

n 

m=i {k,e)eR,n\Rm-i 



(1) 

n,25 



(2) 
ra,25 



EV^ ^(1) ^(2) _ _ ^(3) _ ^(3) ^(3) 

/ ^ '^m,2,k,e^m,2,k,e ~ '-'n,5 ^n,l '^n,2 "r '-'n,3' 

m=i (k,e)eRm\Rm-i 

where 

n m / k—1 \ 2 n ra ^ fc— 1 \ 

m=2fc=2^j=l ^ m=2fc=2^j=l ^ 

71 m / l—\ \ 2 n m / l—\ \ 

m=2 £=2 ^ 7 = 1 ^ m=2 £=2 ^ 7 = 1 ^ 
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and 



n m / fc— 1 s 

m=2 fc=2^ i=l ^ 
n m / £—1 \ 

^n^ : = X^ X^f ^ ■'^mj j {Xm-l,e - Xm-l,(.-l) , 

m=2 1=2 ^ i=l ^ 

n /■ ra—l \ /■ m—1 \ 

m=2 ^ i=l ^ ^ 7=1 ^ 



Using the independence of the error terms ^j^j, Lemma 2.8 of iBaran et al\ (|2007| ) and 
Proposition 1231 after long and straightforward calculations we obtain that if (a, /3, 7) G J>+ 

Var(c5) = 0{t?), % = 1,2,3, j = 1,2, and Var(ci5) = 0{n), (6.11) 



if (a,/3,7)e£: 



1+ 



Var (ci^]) =0(n^) and Var^C^^^) = ©(n^), j = l,2, (6.12) 



if (a,/3,7) G £^2+ 



Var(ci;]) =0(^3) and Var(ci5) = O(n^), j = l,2, 
while in case (a, /3, 7) G V+ we have 

Var (eg) = 0{n'), z = 1,2, 3, j = 1, 2, and Var (c^^) = 0{n' 



(6.13) 



(6.14) 



In this way, - (16J0|) follow from (KTO\ . ( 13TT|) . (ISTj) . dSlQ]) . (ICTj) and it's pair for the 
case (a,/3,7) G S2+ and f lOTl) - flTOl) . □ 

Proof of Proposition 16.21 Similarly to the proof of Proposition 14.21 it suffices to show 
that if (a,/3,7) G -7-"++ then 



J^m-i ) — > as n ^ 00, 



(6.15) 



E ^ (lie*™ - c*™-! 

m=l 

if (a, /3, 7) G £^1+ U S2+ then 

;^ E E (1^^^ - -^^-1) -^0, 5^ E (\C^£ - A (6.16) 



m=l 

as — 7- 00, where 



m=l 



(1,2), if (a,/3,7)G^i+; 
(2,1), if (a,/3,7)G^2+, 
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while for (a,/3,7) G V+ 
1 " 

m=l 

Using decomposition (16 .ip we have 



^ m— 1 



as n — )• oo. 



(6.17) 



Further, independence of Am,\ and J>„ and measurabihty of Cm,2,k/ with respect to F„ 
imply 



and 
E 



^ (fc/)Gi?™,\i?,„-l ^ 



-^m-ij < ((M4-3)++3) 

respectively. Hence, to prove (I6.15P - (I6.17P one has to show 

hm — y EM2i)' = 



E/ {^m,2,k,£) 

m— 1 



1 = 1,2, 



m=l 



n->-oo n 



(6.18) 
(6.19) 



m=l \ (fc,<?)eRm\-Rm-l 



where 



4 if («,/3,7) G J-++u^2+; 

6, if (a,/3,7)G V+U£i+, 



T2 := 



4 if (a,/3,7) G^++U^i+; 
6, if (a,/3,7) G V+U^2+. 



Obviously, using the same arguments as in the case of ( 14. lip one can easily see that the limit 
(I6.18P directly follows from (14. 2 p and (14. 3p . Further, similarly to the proof of (16. 7p - (l6.1Up . 
after straightforward calculations we obtain 

E (c'A^.A £ E 



m— 1 



{fcl,^l)G-Rm\-Rm-l (k2,l2)(iRm\Rm-l 



(6.20) 



where 
and 



Gki,li,k2,h '■— ^i^ki-l/i — -^fci-l/i-l)^(-^A;2-l/2 ~ -^fc2-l/2-l)^5 



1 " 

lim — E 7^,m = 0. 



(6.21) 



m=l 
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Now, in the case (a,/3,7) G with the help of Proposition 12.31 and Lemma 2.8 of 



Baran et al\ (120071 ). while in the remaining cases by direct calculations one can show that 



if (a,/3,7) G J^++U£2+; 
1), if (a,/3,7)GV+U^i+, 



where Ca,p is a positive constant, that together with f l6.20p and fl6.2ip implies fl6.19p . For 
i = 2 fl6.19p can be proved in the same way. □ 



7 Proof of Proposition 11.6 



Let (a,/3,7) G Using notations (13. 5p introduced in Section |3] and definitions ( II. 3p 

and (II. 4p after short calculation we obtain 

n-"/^5„A„ = (n-^/2QW)(n-iC„) + (n-^^/^Qi^)) (0, 0, 1) (n-^/^A.) , (7.1) 

where Qn^ is a three-by-two matrix with entries 

1) 



Qn,3,l ('5'n,3 + 'S'n^s) S^^s — {Sn,l + •S'n^a) S'„^4 + (S^^s — Sn,l)Tm 
Q\i\,2 '■~ ('S'n,4 + Sn,b)Sn,A — {Sn,2 + Sn,A) Sn,3 + ('S'n,5 ~ Sn,2)Tn, 

and gi') = (gi'l gg)^ with 

/n(2) . Q c C Q /o(^) Q Q Q Q 

Vn,l "Jn, 3^71,5 'Jn,4*-'n,l ; Vn,2 '-'n,4'-'n,5 ^n,3*-'n,2; 

^1,3 Sn,lSn,2 ~ 'S'^^s + {Sn,2 ~ Sn,5)Sn,3 + (*S'n,l ~ Sn,^) Sn,4:- 

Now, Proposition IL2I and limits (15. 4p . (15. 7p and ( 15. 9 p imply 

+ (n-5„,5 - (n-^/^T„) A - -S) , (7.2) 



as n — 7- 00, and using the same ideas one can find the limits of the remaining entries of 
Qn^ and coordinates of Qn^ . In this way 

rz-^/^gW A al.n-'K^,, and n-^^/^g^f) A (O, 0, O)^ 

as n — )■ 00, that together with (17. ip . Slutsky's lemma and Propositions 11.31 and 11.51 implies 
the first statement of Proposition 11.61 
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Further, let (a,/3,7) G Ei^. As in this case S^^/j = (1 - 7^)(0, 1, -1)'^(0, 1, -1), 
short calculation shows 



n 



= K^^/'Qi^^)K^/^^n) + (n-^Qi^)- (4(1-7^))"^^ 1, -1)"^)^^^^^) 

(7.3) 

+ (4(l-7^))-\0, 1, 
where now Qn^ is a three-by-three matrix with entries 

Qn,l,l '■— Sn,lTn — 5'„ 3, ^1,2,2 — ^1,3,3 0; 

Qn,l,2 ~ Qi,2,l 'S'„_3S'„^4 — Sn,hTni 

Qn,l,3 = Qn.S,! {^nfi + 'S'n^s) S^^a — (5*^,1 + •S'^^s) S'n^4 + (^n^s — Sn,l)Tn,, 
Qn,2,3 Sn^iSnfi — {Sn,2 + *S'„^4) S^^a + Sn^^T^, 

Qn,3,2 'S'n, 15*^,2 + ('S'n,2 — Sn,5)Sn,3 + ('S'n,! " Sn,5)Sn,A + ('S'n,! — >S'„^5)T„ 

and Q(f) = (OQg -Q^)^ with 

Qn,3 • = 'S'n,l'S'n,2 + ('S'n,2 — 'S'n^s) S'„,3 + (ySn,l — Sn,'^Sn,A + ('S'™,! — Sn,b)Tn + ('S'n,2 " Sn,b)Tn 
— {Sn,i + 5'„,5)S'„^4 — (5'„,3 + Sn,^Sn,3 + ("S'n,! + 'S'n^s) S'„_4 + (5'„_2 + 'S'„,4) S'„,3 — 

Using Proposition 11.21 and hmits f lS.lOp and ( 15. lip , similarly to (17. 2p one can show that 

^""^'Qil- 0, ^,J = 1,2,3, 

and 

n-^Qg A (4(1 -7^)) -\ n-'Q% A (4(1-7^))-^ 

as n — 7- oo, that together with (17. 3p . Slutsky's lemma and Propositions 11.31 and 11.51 implies 
the second statement of Proposition 11.61 

Finally, if (a,/3,7) G £2+ we have S„,/3 = (1 - 7^)(1, 0, -1)^(1, 0, -1). Hence, 
similarly to the previous case one can prove that the limiting distribution of n^^i?„y4„ 
equals that of (4(1 — 7^)) (1, 0, ~lY {n^^Cn^^ which completes the proof. □ 



8 Proof of Theorem 1.1 



Cases (a,/3,7) G and (a,/3,7) G £i+ ^£2+ are direct consequences of Propositions 

OlandOl 



Parameter estimation in a unit root AR model 



45 



Consider now the case (a,/3,7) G V+. Using notations fl3.5p introduced in Section [3] let 



SnA 
Sn,2 



As by Proposition 11.51 

n-^/^Cn^Af {0,12/2) as n -> 00, 
to prove the last statement of Theorem 11.11 it suffices to show 



n'/'(B-'A^~^^)^{0, 0, 0)^ as 



n — )■ 00. 



(8.2) 



Further, denote by Rn,i,j, hj 
calculations show that 



1, 2, 3, the entries of the matrix Bn — TnSnH. Short 



Rn,l,l '■= 3, Rn,2,2 '■= ~>S'„,45 Rn,l,2 = Rn,2,l '■= Sn,3Sn,4 ~ TnSn,5j 

Rn,l,3 = Rn,3,l '■= Sn,3{Sn,3 + 'S'n.s) ~ Sn,4:{Sn,l + Sn,3) + TnSn,5, 
Rn,2,3 = Rn,3,2 '■= Sn,4:{Sn,4: + 'S'n^s) — Sn,3{Sn,2 + 'S'„^4) + TnSnfi, 
Rn,3,3 '■= {Sn,2 + Sn^i ~ Sn,3 ~ Sn,5) {Sn,l + Sn,3 ~ Sn^i ~ 'S'n^s) 
+ {Sn,3 + Sn,4: + Sn,5) {Sn,l + Sn,2 — 2Sn,5) " 2TnSn,5- 



Now, Slutsky's lemma together with (13. 7p . (I3.10p and (13. lip implies 

n ^^^'^Rn,3,3 = ^ ^^^'^{Sn,2 + Sn,4: ~- Sn,3 " Sn,^n ""^^^^ (S'„^i + Sn;3 ~ Sn,i — Sn^^ 

+ n~^-'l\S^^3 + 5n,4 + 5„,5)n-i3/2(5„^^ + 2 _ 25„,5) - 2n-Xri-'/'5„,5 A 

as n — > 00, and obviously the same result can be proved for the remaining 8 entries of 
Bn — TnSnH . Combining this result with Proposition 11.31 we obtain 

n~^"^(BnAn - TnSnCn) A (O, 0, O) as n^oo. (8.3) 

Using again Slutsky's lemma together with (13.70 . (I3.10p and (13. lip from (15. 2p we have 



n 



-10 



{TnSn,iSn,2 " det(_B„)) as n oo. 



that together with (I3.10p and (18. ip gives us 



n 



17/2 ' ■'-n'^n^n 



q fi 

Sn,lSn,2 



det{B„ 



[n 



[n ^Sn,i){{n ^Sn,2) 

1 



X 



n 



10 



TnSn,iSn,2 ' det(5,)) (o, 0, o) 
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as — 7- oo. In this way (18 .2^ follows from Proposition 11.41 and limits fl8.3p and (18 .4^ . □ 
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